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Abstract: We study the time reversal of a general PDMP. The time reversed process is 
defined as X/ T -t)- 1 where T is some given time and X t is a stationary PDMP. We obtain 
the parameters of the reversed process, like the jump intensity and the jump measure. 

^ 1. Introduction 

o 

The aim of this paper is to introduce the time reversal of a general piecewise deterministic 
> Markov process (PDMP). Given a stationary version Xt of such a process we let = 

g X(r-t)- an d study the characteristics of this reversed process. 

The concept of reversing the direction of time for Markov processes can be found already 
in the works of Kolmogorov ([M] [3S] and even earlier [51] )• The general idea is to study 
the process X£ = _X7y_ t \ , where T > is either a fixed point in time or a suitably defined 
random time. However, it is not clear whether the process X* is a Markov process at 
all and if it is, whether properties like time-homogeneity, the strong-Markov property and 
others hold. Such questions have been answered until the 1970s in several publications 
regarding time reversion (see e.g. |43 [ 144 4 ^ \ I54j ) . Other researchers applied time reversal 
to special classes of Markov processes, like Levy processes ([31]), stochastic networks ([33]). 
birth and death processes ([52]) and Markov chains (|45|). 

PDMPs evolve deterministically on an open subset of interrupted by random jumps 
that happen either inside the state space or at the boundary. Piecewise deterministic paths 
can be observed for Markov processes in a variety of applications. We mention risk process 
( HI S3 EH (2UJ [25] ) , growth collapse and stress release models ( E3 ESI CES EEE] ) , queueing 
models ([EHH]), earthquake models ([IS])) repairable systems ([38 ), storage models ( [T5] 
I2T] I28| ) and TCP data transmission |4"0"] [M]). The mathematical framework that is 
used in this paper was introduced by Davis [22J [2T] . Other approaches to PDMPs and 
related processes can be found in [32] EJJ] EJJ] Sj5], see also [5] [TS] [2HJ [57]. However, it seems 
y— i that time-reversal has not been a subject of detailed study for PDMPs, at least not in a 

general framework (see [2B] for time- reversal arguments for a special subclass). To fill this 
gap we study the reversed process of a general PDMP, allowing also for what is called a 
non-empty active boundary, i.e. forced jumps that occur whenever the process hits the 
boundary of its state space. 

This paper is divided into three sections. In the first section, after recalling the definition 
of PDMPs, we investigate the imbedded Markov chains (Wk)k=i,2,... and {Qk)k=l,2,... ob- 
tained by observing the process just before and right after the jumps. Among other things 
we derive a formula for the stationary distribution of = (Wk, Qk). Also in Section 1 we 
derive some sufficient conditions to ensure that the stationary distribution v of the original 
PDMP is absolutely continuous. 
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In Section 2 we define the reversed Markov process (X*)t>o (we use an asterisk to denote 
variables related to the reversed process) and show that it is a PDMP. Moreover, we prove 
that tt(A, B) = tt*(-B, A), where n and 7r* denote the stationary distribution of and Z\. 
More specifically we find the crucial relation 

H x (dy){X{x)v(dx) + a(dx)) = ^ y (dx)(\*(y)v(dy) + a*(dy)), (1) 

where a denotes the measure that is equal to the average number of visits to the boundary. 
This formula can be used to derive the jump intensity A*(x) and the jump measure /U*,(j4) 
of the reversed process - one of the main aims of the paper. We also rediscover that in our 
setting the well known property of the generator A* of X* to be the adjoint of A holds. 

Section 3 is devoted to PDMPs on the real line, that is PDMPs with state space EC1. 
We derive an integral equation for the stationary distribution and study some special cases. 

We will introduce certain conditions for the process to hold. More specifically, we have 
conditions (A) to ensure that Xt is a proper PDMP, conditions (B) and (D) to be able 
to revert the process and condition (C) to obtain an absolutely continuous stationary 
distribution. 

1.1. Preliminaries. Throughout the article we use the following notations. We let id 
denote be the ci-dimensional Lebesgue measure and write /ii <C fJ-2 if a measure fj,± is 
absolutely continuous with respect to another measure fj,2- In this case the symbol d^i/d^ 
stands for the Radon-Nikodym derivative. If [12 is the Lebesgue-measure we shortly write 
fi'i instead of dfj,\/d£. The same notation /' is used for the Radon-Nikodym derivative of 
an absolutely continuous function /. Given some measure \i we denote h\a(B) = fi(Ar]B) 
the restriction of fi to A. 

We use the abbreviations and for the expectation and probability, given that the 
process Xt starts with initial probability distribution fj, (which will often be the stationary 
distribution v). In particular, if /j,({x}) = 1 then we write E x and P x . Given a set A C Mr, 
3$(A) indicates the Borel-cr-field of subsets of A. 

The typical feature of a PDMP is of course its eponymous path that consist of random 
jumps and piecewise deterministic segments. The jumps are steered by a jump intensity 
function, allowing the jump times to depend on the current state of the process, and 
a jump measure, determining the distribution of the destination of the random jumps. 
Additionally the process is allowed to change its state continuously between the jumps. 
In general, if <p(x, t) denotes the position of the process at time t, given that there were 
no jumps and that the process started in x, the appropriate condition on ip in order to 
obtain a deterministic time homogeneous Markov process is to form a flow, that is to fulfil 
the relation ip((p(x, t),s) = tp(x, s + t) for s, t > (see e.g. [301 S2])- If one wants to keep 
it general, this would be the only restriction to the deterministic paths and no further 
regularity and continuity conditions have to be imposed. 

In this paper we instead follow the more restrictive (and more popular) set-up demon- 
strated in the book of Davis (22] (see also [TH1 ED HE]), where the deterministic paths 
of the process are governed by a differential equation as follows. Let E° C M. di , di £ N, 
i E K = {1, 2, . . . , k}, k E N be a collection of open sets and let <9E.; denote the boundary of 
E°. We assume that on each component E° there is a vector field defined with unique inte- 
gral curve ifi : E° x E — > E°, having no explosions. The idea is that, given that Xq = (x, i) 
with x G Ej and there was no jump during [0, t], the position of Xt is given by ipi (x, t). We 
assume that there are functions r% = (r^i, . . . , rj dj : E° — > M, locally Lipschitz-continuous, 
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such that for all x G E°, the integral curve <p(x,t) is the unique solution of the ordinary 
differential equation j^ipi(x,t) = ri((fi(x,t)). For differentiable functions / : Ej — > R we 
can represent the integral curve using the Lie derivative 

d ^ d 

Xif(x) =lim—f(ipi(x,t)) = J2r id (x)—f(x). 

j=l 3 

More generally, we understand the symbol Xif(x) as a solution of 

f(ifi(x,t)) = f(x)+[ Xif(ip(x,s))ds, 
Jo 

allowing / to be only absolutely continuous. The process (X t )t>o evolves on a subset of 
the disjoint union of the E° U <9Ej and the elements of K represent the outer states of the 
process. In order to give a complete specification of the actual state space of the process we 
distinguish between the following subsets of the boundary <9Ej. First, the so called active 
boundary of points that can be reached from within E° , 

Ti = {z £ dEi : z = <p(x, t) for some x G E°, t > 0} 

and secondly, what we call (in lack of a more appropriate term) the passive boundary, the 
set of points on the boundary from where points in E° can be reached: 

= {z G 9Ej : z = <p(x, -t) for some x G E°, t > 0}, 

of course, as the asterisk indicates, this set will serve as active boundary for the reversed 
process. We also define = E° U T* and E* = E° LIT;. For each set Si G {r^, T*, Ej, E*} 
we define the disjoint union S = {(x, i) : i G K, x G Si}. For example the state space of X t 
becomes 

E = {(x,i) :ieK,x£ EJ, 

while the active boundary is V = {(x, i) : i G K,x G Ti}. Before we proceed we agree on 
the following convention. We will throughout the paper omit the outer states, e.g. write 
x G E instead of (x, i) G E, or X f{x) instead of Xif{x). Only if the notations are necessary 
to avoid ambiguity we well indicate the outer states. 

As explained in the introduction, the process X t jumps at certain random times (Tj)j = i 5 2,.... 
This will either happen from within E (voluntary jumps) or if the process hits the ac- 
tive boundary V (forced jumps). The times at which forced jumps occur are denoted by 
(^ + )i=i,2,...- Let t(x) = inf{t > : (p(x,i) G T} denote the first time the latter happens, 
given the process starts in x G E and no jumps occurred (with the usual convention that the 
infimum is equal to oo if there is no such t). Two random mechanisms determine the jumps: 
the jump intensity is a non-negative, continuous measurable function A : E — > [0, oo), with 
the interpretation that the probability of a jump during [t,t + h], given that the process 
is in the state x, is X(x)h + o(l) and the probability of more than one jump is o(l) as 
h — > 0. Formally this will follow from the continuity of A and from the representation of 
the probability distribution of the first jump time T\ given by 

P X {T X >t) = l {t<T(x)} A x (t), (2) 

where we use the abbreviation A y (t) = exp(— Jq \(<p(y, u)) du). Secondly, the jump mea- 
sure Hx(A) determines the probability of a jump from x G E* into a measurable set 
A C 38(E). Let Nt = sup{n : T n < t} denote the number of jumps (forced and vol- 
untary) and 7V t + = sup{n : T+ < t} the number of forced jumps occurring during [0,t]. 
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Throughout we assume the following standard conditions (c.f. [22 J: 
Condition A. 

(JA|l ) For all x EE there is an e(x) > 0, such that /g ^ \(ip(x, s)) ds < oo (local integra- 
bility of A along ip ); 

(|A^) Jq°° \(tp(x, s)) ds = co for all x E E with t(x) = oo (first jump happens in finite 
time); 



(A 
(A 



Ex(Nt) < oo /or all x E E and all t > (there are no explosions); 
jj, x ({x}) = /or a// x E E (no jumps of size zero); 



Additionally we assume further conditions to ensure that we can define a proper reversed 
process and to be able to derive formulas for the parameters of the reversed process. In 
what follows we define 

d h B = {x E E : t(x, B) < h} 

for any set B E 3) '(E U T) to denote the locations from which the process can reach B 
within h time units. 

Condition B. In this paper we always assume the following conditions. 



There exists a stationary distribution v of X t on E; 
f E X{x)u(dx) < oo; 
3) A is continuous; 

(Bt) For any A E ^(E) and every x E E we have [J> v ( x ,h){A) — > fJ> x (A) as h — > 0. 
Hx(dhT) —> uniformly for x E T as h — > 0. 

Remark 1. Condition ([h^]) assumes the existence of a stationary distribution of the process. 
This will be crucial for the definition of the time reversal in Section [2] Giving appropriate 
conditions for a general PDMP to possess a stationary distribution, to be ergodic, positive 
recurrent or Harris recurrent is a difficult if not impossible task. Different efforts have 
been made to solve these problems for special cases ( [S3 EH1 HE] ) • We take the liberty to 
keep away from these intricate questions and just assume our process to posses a unique 
stationary distribution, being aware of the difficulties that we leave untouched. 

Remark 2. Condition ( |B^j ) prevents the process from becoming cascading near the bound- 
ary, i.e. to jump more and more often from T into a smaller and smaller neighbourhood of 

r. 

Remark 3. With these conditions holding there are no hybrid jumps, that is, we do not 
allow the situation where there is an x E E such that Xt jumps with a certain probability 
p{x) once it reaches x and with probability 1 — p{x) it stays on the flow. This restriction 
becomes important for the reversed process. 

We will also need the following substitution rules. Let r(x, y) = t if y = (f(x, t) for some 
t > and r(x, y) = 00 else. Then r(x, y) represents the time the process needs to run 
from x to y if no jumps occur. Let <& y x = [J t >o{'-p{x, s) E E : s E [0, t], and y = <p(x, t)} and 
<J>+ = {(f(x,s) E E : s E [0,r(x))} denote the curve segments starting from x and ending 
at y and at the active boundary, respectively. Then we can rewrite the line integral over 

rr(x,y) 

f(u)du= f((f(x,s))\r((p(x,s))\ds, (3) 

Jo 
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where \r(u)\ = (J2f=i r f{ u )) 1 ^ 2 ■ Similarly, provided that \r(u)\ > on & x , the integral over 
f(ip(x,s)) with s G [0,t(x,ii)] can be written as 

r(x,y) f f( u ) 

„ WhRSJI*'- (4) 

It follows in particular that r(x,y) = J^y l/|r(u)| du. 

Let j$ denote the class of measurable functions / : E* — > M and the class of those 
members / G for which t — > f(ip(x,t)) is absolutely continuous (so / is absolutely 
continuous along the flow). We define the linear operator 

Af(x) = Xf(x) + \(x)Qf(x), (5) 

where Qf(x) = / E (/(y) — f(x)) /j, x (dy). A is the full generator of the Markov process X t 
and we denote by S>{A) the domain of A, so that for / G $i(A) the process f(X t ) — /(Xq) — 
Jo <Af{X s ) ds becomes a martingale. These functions are characterized in \22\ Th. (26.14) 
and Rem. (26.16)]. Note that the class of bounded functions / G with Qf(x) = for 
all x G T is contained in the domain. We let denote the bounded functions in We 
note that for all / G 

f(X t ) - f(X ) - f Af(X s ) ds - f Q/(X S _) dN+ (6) 
Jo Jo 

is also a martingale. 

1.2. Stationarity. The process Xt- will hit the active boundary T at certain times 
(T+) n >o and is then forced to jump. Let N^~(B) denote the number of hits of a set 
B G ^(r) during the time interval [0,i] and = Nt(T). It is shown in |22| Theorem 
34.15] ( |18| Proposition 2]) that there exists a finite measure a on the active boundary 
r such that a measures the time-average of the number of visits to B, namely <r{B) = 
E v (Nt~(B))/t for every t > 0. That is, for any bounded function / G ^# and any t > 0, 

f(x)a(dx) = \e v { f f(X,-) dN+). (7) 
r t Jo 

Many of the upcoming results of this paper are based on the following crucial relation. 
Taking expectations in ([6| with respect to v and taking into account that E v {f{X t )) = 
E u (f(X )), we obtain tE u (Af(X s )) + E„(Jq Qf(X s J) dN+) = for every / G J(' h% so that 
we have the identity (see \22\ Theorem 34.19]): 

/ Af(x)v(dx) + f Qf(x)a(dx) = 0. (8) 
Je Jt 

Equation (|8j is the usual starting point to find expressions of v in terms of the parameters 
A and \x x of the process. In general however there is not much hope to find explicit formulas 
and only for a few PDMP models the stationary distribution v is explicitly known. Even in 
the one-dimensional case often all that can be done is to derive integro-differential equations 
for v (see Section|3]for examples) and even these equations give rise to challenging problems 
themselves. 

Another interesting question is, whether it is possible to further describe the measure 
a and express it in terms of the stationary measure v on E°. In fact, a is determined by 
the values of v on arbitrary small neighbourhoods of T and for B G 3$(T) the measure 
<j{B) is given by the limit probability to find Xt in short distance to B (measured in time 
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units needed to reach B). Let t(x,B) = r(x,y) if y = f(x,t) E B for some t > and 
t(x, B) = oo else. 

Proposition 1. For B E £8(T) the measure ct{B) is given by the limit 

a{B) = lim (9) 

Proof. The function f h : E* -> [0, 1] 

fh{x) = (1 - • l { , e9h B } 

is absolutely continuous, bounded and vanishes on IE \ dhB; in particular fh E jft 1 ^ and 

#/ h (:r) =lim^/? l (¥'(x,t)) = - ^l {xedhB} lim ^T(ip(x,t),B) = {x£ ^ hB} , 

Application of Q to then yields 
1 



,u(d h B) + / X(x){ / ^(dy) - / h (a!))i/(cte) 

h Jd h B Jd h B 



(/ fh{y)^x{dy) - f h {x))a{dx), 



from which it follows that 



\v{d h B) = a{B) - [ [ f h (y)fM x (dy)a(dx) - [ X(x)(n x (d h B) - f h {x))u{dx). 
n Jr Jd h B Jd h B 



fh(y)Vx(dy)a(dx) - / X(x)(fi x (d h B) - f h {x))u{dx) 
r Jd h B Jd h B 



h 

Note that 



< / fi x {d h B)a{dx) + / X{x)v{dx). 
Jr Jd h B 

As h — > the integrals on the right tend to zero by dominated convergence, where we used 
condition §Bfe) and v(T) = 0. □ 



1.3. The embedded processes. To gain insight into the behaviour of the process it is 
useful to study the continuous time process (X t )t>o sampled at the jump times (Ti)j = i t 2,.„. 
To this end we define the two-dimensional process Zk = (Wk, Qk), where Wk = Xx k _ and 
Qk = Xx k denote the embedded discrete time Markov processes, obtained by observing Xt 
just after and right before the jumps. Note that due to the forced jumps the state space 
of W is E*, whereas Q lives on E, so that E^ = E* x E is the state space of Z. 

If Xt is stationary then still Wk and Qk are usually not stationary and vice versa. 
However, if Wk is stationary then so is Qk- If v is the stationary distribution of Xt, then 
we will show how to find a stationary distribution for Z&. 

Let for A E ^(E*) and B E 

p(h; A, B) = P V {X Q E A, X h E B, 7\ E [0, h)) 

denote the probability that (under v) Xq E A, Xy L E B and the process is going to jump 
during the time interval [0, h]. 
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Proposition 2. For all A £ 3§(W) and B £ £%(E) the limit p(h; A, B)/h exists as h ->• 
and it is given by: 

£(A,B) = lim PihAl 13 ! = f \( x )^ x ( B )v{dx) + f fi x (B)a(dx). (10) 

Proof. Suppose first that B is open. The probability p(h; A, B) is a sum of the probabilities 
of the following four events: 

1) We have Xq £ (A Pi E) \ dh(A D T), i.e. Xq is not close to the boundary and a jump 
occurs within h time units, say at time s. Moreover, X s £ dh- s B and no further jumps 
occur, so that the process will end up in B at time h, as desired. The probability of this 
event is given by 

pi = [ [[ A z (h- s)fj, (p r xs \(dz)A x (ds)u(dx). 

J JO Jd h . 3 B 

(Arw,)\d h (Anr) 

Since B is open, we have that l! Zh& Q h sB \K Zh {h — s) — > l{ zeB } f° r an Y sequence {z^} £ E 
with Zh — > z, z £ E as h — > and by condition (J^jg) it follows that ^^^(dh-sB) — > Hx{B) 
as h — > 0. Hence, by Theorem 5.5 in |7] f g B A z (h — s)fj, ip ( x ^(dz) — > (i x (B) as h — > 0. 
Since A x (ds) = A(c/?(x, s))A x (s) ds and A x (s) — > 1 as h — > 0, it follows from the continuity 
of A (condition (|h^j)) that 



pi = /i / X(x)n x (B) u(dx) + o(h) = h J \{x)^ x {B) u{dx) + o(h). 
(AnE)\<9 h (Anr) ^nE 
The last equality is a consequence of the fact that v{dh{A n T)) — > as h — > since 

Kr) = o. 

2) The event that Xq £ D T), a unforced jump occurs at time s before the process 
reaches T, X s £ dh- s B and no further jumps occur is given by 

r r T ( x ) r 

P2= / / A z (h- s)/j lip r xs )(dz)A x (ds)u(dx). 

Jd h (Anr) Jo Jd h - S B 

Since t{x) — > and v{dh{A n T)) — >■ as h — > 0, it follows by similar arguments as before 
that P2 = o(h). 

3) Xq £ dh(A n T), the process reaches T at time r(x), X s £ dh- s B and no further jumps 
occur. The probability is given by 



p 3 = / A z (h-T(x))fj, ( {x)) {dz)A x {r{x))v{dx). 

Jd h (Anr) Jd h _ T(x) B 

As in 1) we have that l^ ze g hr B yA z (h — r(x)) tends to l{ z g_B} for any sequence {zh} £ E 
with Zh — > z, z £ E as h — > and f-icp( XtT (x)) 

(d h - T ( x )B) -» fi x (B). Consequently 
A z (h - T(x))fi !p{XtT(x)) (dz)A x (T(x)) -> fi x (B). 

dh-T(x) B 

From Proposition [T] it follows that v(dh(A n T)) = ha(A n T) + o(h). Hence 



P3 = hi Li x (B)a(dx) + o(h). 
Jac\T 

4) We finally investigate the case, where more than one jump occurs during the time period 
[0,h], The probability of this event is o{h) as h — ¥ 0. This follows immediately from the 
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definition, if the process does not reach the boundary. If on the other hand Xq £ d^T (the 
probability being 0{h)) then the probability to jump to d^T again is oil) by Condition 

Altogether we obtain 

pih;A,B) = h[ X(x) fj, x (B) u(dx) + h [ n x (B)a{dx) + o(h). (11) 
JAnE JAnr 

This completes the proof for the case, where B is open. The general case follows using 
classical arguments. □ 



The total mass ||f|| = £(E*,E) = J E X(u) vidu) + a(T) is finite due to (^j) and it has 
been shown in |18| Proposition 5] (and |22| Theorem (34.21)]) that ||£|| is strictly positive. 
Consequently, we can define a probability measure 

ir(A,B) = Z(A,B)/U\\ = TfJirC /" ^)^(B)u(dx) + f ti x {B)cr{dx)) (12) 

||f II v JAnE JAnr ' 

on Kz- 



Theorem 1. it defined in (12) is a stationary measure for the Markov chain Z. 



Remark 4. Compare with (22| Theorem (34.21)] and |18| Theorem 1], where it is shown 
that the marginal distribution 7r(E, •) is a stationary distribution for Q. The present proof 
follows partly along the lines of the proofs presented there. 

Proof of Theorem^ Let f(y) = E(f(Wk, Qk)\Qk-l = v) € M' h for some function / £ J(' h . 
Conditioning with respect to the first jump time of the process we obtain: 

~ f T (y) r 

f(y) = / f{p{y,s),u) fi^y tS) {du)X{ip{y,s))A y (s) ds 



+ J : f(<p(v, T (y)),u) /i ( p( y)T ( w ))(d«)A 1/ (T(y)). 

It follows from the flow property tp(ip(x, t),s) = (fix, s + 1), that 

^ rr(y) r A is) 

/(y(y>*)) = J t J E f(^(y^),u) ^ { y tS) idu)Xiipiy,s))^-^ds 

f(tp(y, r(y)),u) My(y,T(»)) 

E A 2/W 
t 



Jt) ~ jo je S ^ ,U ^ V v (y,s){du)Xiipiy, s))A y (s) ds) . 



Ay(t) 

Since Xf(y) = lim^o f t Kvty, we obtain <^/(y) = A(y)(/(y) - / E /(y, u) fi y (du)). It 
follows that the generator applies to / in the following way, 



Af(y) = A(y) (/(y) - j /(y, u) ^(d«) + Q/(y)) 

= A(y) (/(y) - / /(y, u) ^(d«) + / (/(«) - /(y)) ^ W, 
v Je Je ' 

= A(y) / (f(u)-f(y,u))v y (du). (13) 
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Next we show that £ is an invariant measure for Z, i.e. £/ = £/, where we use the usual 
abbreviation £/ = J E f(x,y)£(dx,dy) and £/ = J E f(y)£(dx,dy). It follows from Q and 



(13) that 



Kv) / (/(«) " f(v, «)) + / / (/(«) - /(y)) <7(dy) = 0. 

E JE Jr JE 

Hence, using the identity f(y) = J E f(y, u) fJ, y (du) for y £ T, we have: 

Kv) / K u ) fJy{du) u(dy) + / / f(u) Hy(du) a(dy) 
E JE Jr JE 



Kv) / f(v, u ) fJ>y(du)v(dy)+ / / f{y,u)fi y {du)a{dy) 

E JE JT JE 

proving that £/ = £/. □ 

It follows immediately that a stationary distributions of Wk (the state of the process 
just before the jump) is given by 

tt w (A) = ±r( [ \(x)v(dx) + a(AnT)), (14) 
||£|| v JAnE J 

for A £ BS{K*). The restricted measure ttw |e is absolutely continuous with respect to v with 
Radon-Nikodym derivative A, whereas on the active boundary 7Tty|r is a constant multiple 
of the measure a. Note that for an empty active boundary and a constant jump rate 
the above relation shows that the PASTA property (Poisson Arrivals See Time Average) 
tt w (A) = v{A) holds. 

By Theorem [T] a stationary distribution for the observations Qk of the process right after 
the jumps is given by 



ttq(B) = / fx x (B)ir w (dx) (15) 
JE* 

= ( j£ X(x)fi x (B)u(dx) + fi x (B)a(dx)^j , 
for B £ £$(E), confirming the results in |22[ I18|. Note that the formula for ttq follows from 



( 14 ) after conditioning on the jump size. 



1.4. Absolute continuity of the stationary measure. It is interesting to ask under 
which conditions v is an absolutely continuous measure (w.r.t. Lebesgue measure). This 
property jointly with absolutely continuity of the jump measure or stationary measure ttq 
simplifies the identification of the parameters of the reversed process. For one-dimensional 
models on the real line v was found to be absolutely continuous under very mild conditions, 
see [SSJ 13 EH ESI EH HE] ■ This is in accordance with countless observations of absolutely 
continuous stationary distributions for PDMP type stochastic models in the literature (e.g. 
[21[r21[T3J|27l[51[51llD]). However, in general, i.e. for higher dimensions, it seems very hard 
to give necessary and sufficient criteria. 

We introduce one more condition on the process Xf. 
Condition C. E^ Q {Ti) < oo. 

Remark 5. The condition is satisfied in the vast majority of cases. The reason to introduce 



it is the following useful converse to (15). If E nQ (Ti) < oo then the stationary measure u 
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can be reconstructed from ttq by an argument from regeneration theory. Note that under 
ttq the time until the first jumps occurs forms a cycle, hence, by [31 Corollary VII 1.4], 

E* Q U?f{X a )d8) 

E v {f{X )) = — — — ; (16) 

(c.f. with |18| equation (12)]) for bounded continuous functions /. 

Recall that the state space E consists of a disjoint union of components Ej: E = {(x, i) : 
i £ K,x £ Ej}. The following proposition gives a criterion for absolute continuity of v on 
one of these Ej, i E K. 

Proposition 3. Suppose that, additionally to Condition ([C]) ; r(x) for all x E Ej. If 

d{i) = 1 then u is absolutely continuous on Ej. In general, v is absolutely continuous on 
Ej if ttq is absolutely continuous there and r is continuously differentiable. 



Proof. It follows from (16) that 

v{A)<cE VQ {j\ {x ^ A }d8) (17) 

with some constant c > 0. If d(i) = 1 and r{x) ^ 0, then i\(A D &%) = for all Lebesgue 
null sets A E &(M) and in particular E x (f Q 1 l{x s eA} ds) = 0. It follows from (17) that 
y{A) = 0, showing that v is absolutely continuous. In the general case, i.e. if d{i) > 1, 
suppose that ttq is absolutely continuous. We have 

E n Q ( r hXs^A} ds) < [ E^Ti) 7T Q (dx), (18) 
Jo J Ca 

where Ca = {x E Ej : l{ ip ( X)S )<zA} ds / 0}. If we can show that Ca is a Lebesgue null 
set, then it follows that itq{Ca) = 0, since ttq is absolutely continuous. But then the right 
hand side of (18) is zero and absolutely continuity of v follows from (16). To show that 
&d{i)(pA) = 0, suppose the converse. Then 

0< J^J^ l{s<T(x),ip(x,s)eA} dsdx = J l{ s <T(x),ip(x,s)eA}dxds. (19) 

If r is continuously differentiable then : x i— > (p(x, —t) is also continuously differentiable 
(e.g. [23 p. 95]). It follows that Ct maps Lebesgue null sets to Lebesgue null sets (see 
[571 Proposition 26.3]) and that the integral of J E . ^{ s < t (x),lp(x,s)€A} dx over the indicator 
function of the image Cs(A) of A, must be zero, contradicting (19). Hence -^(^(CU) = 
and v is absolutely continuous. □ 

Remark 6. The condition on r can be relaxed. In fact it is enough to require that Q fulfils 
the weaker condition 

v \Ct{x) - Ct{y)\ ^ fr>n , 

sup hm . : < oo. (20) 

x£ E x ^y \x-y\ 

In that case fulfils what is called Lusin's condition (N), that is Q maps null sets to null 
sets ([STJ Proposition 26.2]). 
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2. The reversed process 

2.1. Definition. We now assume Xt to be stationary, that is, the process starts with 
initial distribution v and then has the same distribution for all t > 0. We pick a fixed 
time T > and define the reversed process for t E [0, T] by X* = X( T _ t ^_ (we indicate 
variables belonging to the reversed process with a star). Then X£ is a right-continuous 
stationary stochastic process with state space E* and initial distribution v. Obviously the 
active boundary of the reversed process is given by T* and conversely the passive boundary 
is now r. It is known (see [13] and |44[ Theorem 2.1.1]) that X£, constructed in this way, is 
again a time homogeneous Markov process. Obviously X* inherits from X% the property to 
have piecewise deterministic paths with random jumps and no explosions. So X* would in 
fact be a PDMP if we could show that X^ has a regular jump intensity A*, in the sense that 
the conditions ( |Aj][] ) and ( p^] ) for A have to be fulfilled also for A* (this is not self-evident, 
see the example below). Therefore, we have to impose two more conditions on the process 
Xt, namely ttq has to be absolutely continuous on E° (allowing a mass on T* = E \ E°) 
with a locally integrable Radon-Nikodym derivative, which in Proposition [4] below will be 
seen to be our jump intensity function for the reversed process. 

Condition D. From now on we assume: 

(JDJl) ttqIeo -c v with Radon-Nikodym derivative fi(x) = dirq\%o / dv{pc) , x E E°. 
(fD^) For all x EE there is an e(x) > 0, such that Jq ^ ^{^{x, ~ s )) ds < oo. 



Proposition 4. Under Condition ([DJ) the reversed process is a PDMP, fulfilling the con- 
ditions |A^])-([A^]), with intensity function given by A*(x) = ||£||/3(x). 



Proof According to (11) the probability p*(h;B,E*) that X 4 * E B C E° and that the 



process has a voluntary jump during [t, t + h] is given by 

p*(h;B,E*) = h- [ X(x)u(dx) + o(h). 



B 



On the other hand, by construction of X*, p*(h; B, E*) is equal to the probability p(h; E*, B) 
and hence equal to 

(21) 



p(h; E*, B) = h ■ ( J X(x) /j x (B)u(dx) + J /j x (B)a(dx) + o(l) 
= fc[|eiKg(B) + o(h) = ft / U\\f3(x) u(dx) + o(h), 



yielding A*(x) = ||^||/3(x). Condition ( |P| ensures that A* fulfills Qj). Moreover the 
condition ( [A^] ), i.e. P(T* < oo) = 1, certainly holds. Indeed A*(x) is a proper intensity 
function for the PDMP X* t . □ 

Remark 7. Since 

A*(sMdx) = lieil / P(x)v(dx) = ||elk (E*) < oo, 
it follows that drM always holds. 



Remark 8. Condition (|Dj) is not always fulfilled, as the following simple counterexample 
shows. Consider Xt on [0,1] with Xf(x) = f'(x) (linear growth with rate one), T = {!}, 
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X(x) = for x £ [0,1), /xi(A) = |(l{i/2e>i} + l{oeA})> so that jumps can go from T to 
and 1/2 only, each with probability 1/2. It is not difficult to show that 

KM) = 1 ^ 2 > 2x + 1 ^ 1 / 2 > (4x " 1) , 

hence the stationary measure is absolutely continuous, but ttq is certainly not. What 
happens is that the reversed process X* is not a proper PDMP since with a positive 
probability the process is forced to jump when reaching 1/2. 

2.2. The parameters of the reversed process. The following theorem shows that 
the stationary distribution of the reversed Markov chain Z£ = {Wt,Q%) is given by the 
measure tt, but with reversed arguments. 

Theorem 2. For all A £ &(E*),B € #(E) we have n(A, B) = n*(B,A). 

Proof. The probability p*(h; B, A) that X* £ i? and that the process jumps during [t, t+h] 
into the set A is equal to (c.f. (|21[)): 

p*(h;B,A) = h\\e\h*(B,A) + o(h). 

At the same time, by the definition of the reversed process, p*(h;B,A) = p(h;A,B) 
so \\Ch*(B,A) = \\Z\\ir(A,B) + o(l), implying first ||^*|| = ||f|| and then ir*(B,A) = 
■k(A,B). □ 

We can also write this as 

Hl(dx)(\*(y)v(dy) + o*{dy)) = ^ x {dy){\{x)u{dx) + a{dx)). (22) 
Integrating over y £ A C E, x £ B C E* we obtain 

lf y {B){\*{y)v{dy) + a*(dy)) = f fi x (A)(X(x)u(dx) + a(dx)). 



The terms in the parentheses in (22) coincide with the stationary distributions of W and 
W* respectively. Hence we obtain the shorter representation 

fix{dy)irw{dx) = Lil(dx)7Tw{dy). (23) 

In particular the stationary distributions of the imbedded Markov chains correspond to 
each other: ttq = ir^y and 7Tw = ^q- 

Frequently the jump measure fx x is absolutely continuous with respect to some other 
measure \i for every x £ E*. If this is the case, the same is true for the jump measure of 
the reversed process as the following corollary of Theorem [2] shows. 

Proposition 5. Suppose that fi x <C \i with some measure [i on E for every x £ E*. Then 
ttq <C fj, and 

*p-(y)fi(dx) = d ^{y)7: w {dx). (24) 
The jump intensity of the reversed process fulfils 

\*{y)v{dy) = \\t\\ d ^{y) ^\ E *{dy). (25) 
For the boundary measure we have a* <C /x|r* and 

a*(dy) = U\\ d ^-(y)> J i\ r *(dy). (26) 
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Remark 9. If fj, x is absolutely continuous for every x G E* and r is continuously differ- 
entiable then by Proposition [3] the stationary measure v is absolutely continuous, which 
simplifies most calculations. 



Proof. It follows from ( 15 ) that the stationary distribution of Q is absolutely continuous 
w.r.t. fj,, with derivative given by: 

d7TQ (y)=f d ^(y)n w (dx). (27) 



dfJ, Jx£E* dfi 

By Theorem [2j equation (23) and the fact that ir^y = ttq it follows that 

d j^(y)K d y) 7T w(dx) = fj,l(dx)7Tw(dy) = fj,*(dx)Tr Q (dy) = d ^-{y)^i k y {dx)n{dy), 



implying ( 24 ) . From ( |22[ ) and ( 24 ) it follows now that 

X*(y)u(dy) + a*(dy) = n(dy), 



from which (25) and ( |26| ) can be deduced. □ 

Remark 10. We have \x x <C (jl for example if fJL x (A) = fj,(A D B x )/fi(B x ) for some set .B x 
with n(B x ) > 0. Then the Radon-Nikodym derivative is given by 

d Vx ( a = 1 {yeB.} 

For example, if is the Lebesgue- measure then /i^ is the uniform distribution on S^. 

Remark 11. Suppose that Qj = <7jy(-Bj); where : M d — )■ E is continuously differentiable 
with det Dg^ 7^ (here D is the Jacobian) and B\, B2, ■ ■ ■ are i.i.d. random variables with 
values in C = {z G M rf : g x (z) G E, Vx G E} (we assume that E is such that C is non-empty) 
and an absolutely continuous distribution with density /. Then 

> J c {g*{v)eA}JW J^ {c) \ detDgx ( y) \ J A \det Dg x (y)\ 

so that fi x <C £ with density 



/4(l/) = ^^(C)}- 



det Dg x (y)\ 

Suppose for example that the frequent situation where Qi = Wi + Bi is present, so that 
the jumps are random translations. Then g x (y) = x + y, C = {z : z + x G E, Vx G E} and 
/i x is absolutely continuous with density 

rfxiv) = l {yac+x}f{y ~ x). 

According to the classic literature on reversed Markov processes (see |43| 134] ) one would 
expect that the generator .A* of X* is the adjoint operator of .A, that is 



g(x)Af(x)u(dx) = / f(x)A*g(x)v(dx), 
Je* 

for bounded functions /, g in 3>{A) D @(A*). This is indeed true and in the case of PDMPs 
this result takes the following form: 
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Theorem 3. For f,g£ ^i' b we have 

g{x)Af{x)v{dx) + J^g{x)Qf{x)a{dx) 

f(x)A*g(x)v(dx)+ [ f{x)Q k g{x)a\dx). (28) 



Proof. Using the representation Af(x) = Xf(x) + X(x)Qf(x), it follows that 
g(x)Af(x)u(dx) + / g(x)Qf(x)a(dx) 



g{x)Xf{x)v{dx) + / g(x)Qf(x)[\(x)v(dx) + a(dx)]. (29) 
Je* 

Leibnitz's rule X(fg) = X f ■ g + / • Xg and the definition of Q imply that the r.h.s. of 
(29) is equal to 

" X(fg)(x)u(dx) - f f(x)Xg(x)u(dx) 



+ / / (g(x)f(y) - g{x)f{x))n x {dy) [\{x)v{dx) - a(dx)] . (30) 

JE* JE 

It follows from ([8| that the integrals w.r.t. v of X(fg)(x) and —X(x)Q(fg)(x) coincide. 
Hence (30) equals: 

r \{x)Q{fg){x)v{dx)- f f(x)Xg(x)v(dx) 

E JE 

(g(x)f(y) - g{x)f{x))n x (dy) [X(x)u(dx) - a{dx)) , 

ie* Je 

which, again by the definition of Q, produces: 

f(x)Xg(x)u(dx) + f f (g(x)f(y) - g{y)f{y))^ x {dy) [\{x)v{dx) - a(dx)} . 



E* JE 



Since n x {dy) [\{x)v{dx) — a(dx)] = ^y(dx) [)\{y)v{dy) —a*(dy)] by Theorem[2j this is equal 
to 

f(x)Xg(x)u(dx)+ [ [ (g(x)f(y)-g(y)f(y)) fJ ,*Jdx)[X*(yndy)-a*(dy)] 



E JE* 



= / f(x)A*g(x)u(dx)+ [ f{x)Q*g{x)a*{dx). □ 
je* Jr* 

3. Processes on the real line 

3.1. Introduction. In this section we assume that Xt has values in M. and that t >—¥ (p(x, t) 
is strictly increasing, that is Xf(x) = r{x)f'{x) with some locally Lipschitz-continuous 
function r : E — > R with r{x) > 0, x £ E°. The state space of Xt is a real interval [1^,7), 
w < 7, where it is allowed to have either w = —00 (then E = (—00,7)) or 7 = 00 (then 
E = [w,oo)) or both (in which case E = M). We assume that t{x) < 00 for some (and 
then all) x £ E, whenever 7 < 00, so that {7} can be reached in finite time (otherwise one 
could transform the state space to obtain the 7 = 00 case). Hence, the active boundary is 
empty if 7 = 00 and is equal to {7} else. 

The following figure shows typical sample paths for the case where A(x) = 1 (Nt is a 
Poisson process), r(x) = 4 — x i.e. tp(x,t) = 4 — (4 — x)e~ l , 7 = 2 (so T = {2} and 
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E = (—oo,2)) and n x (dy) = e y dy, i.e. the process jumps from x to x — Z, where Z is 
exponential with mean one. 




Conditions for the existence of a stationary distribution v can be found in [58] The 
boundary measure a is determined by the single value c({7}) which can be calculated as 
follows. According to ([9| we have 

a w v v({x:r(x,i) <h}) 1 f 

^({7} = hm n 7 = Jim r / 1 {r(x r ,)<h}^(dx) 

= i im n r / r (<^(7, -s)W(v > h, -«)) ds = r(i)v (7). 
h-yO h Jo 

The following Theorem generalizes known formulas for the stationary density (see e.g. [3] 
p.383], 13 Theorem 2.1], [40, Theorem 1], [TJ Proposition 4], c.f. [371 Proposition 2.2]). 

Theorem 4. The stationary distribution v is absolutely continuous on [10,7). The density 
v' of v fulfills the integro- differential equation: 



r{x)v'{x)= I \{z)9{x, z)v'{z) dz + a({ , y})9(x,j), x e (10,7), (31) 

J w 

where 6(x,z) = l {x < z} fi z ([w,x)) - l{ x>x }Hz{[x,l)) = (i z ([w,x)) - 1{ X>Z }. 

Proof. Suppose that / G ^' h . Then / is absolutely continuous and f(y) — f(x) = 
fx f'( u ) du, with a measurable /' : E° — > M. Hence, using Fubini's theorem, 



(f(y)-f(z))fi z (dy) 



7 (V 



f \x) dx Hz{dy) 



w Jw 
7 



7 n 



Qf(z) = 

Jw 

ri n ill 1 

1 {z<x< y } Hz(dy)f(x)dx - / l{ y<x<z }Hz(dy)f (x)dx 

Jw Jw 

[ l {x>z}Hz{[x,l)) ~ l{ x < z }Hz([w,x)))f'(x) dx. 
It follows from (|8l), applying Fubini once again, that 



K7) 



r(x)f (x)u(dx) 



\{z)Qf{z)v{dz)-a{{ 1 })Qf{ 1 ). 



( / X(z)n z ([w, x))y{dz) 

w ^J\x, , y) 



\w,x) 



X(z)fi z ([x, i))v{dz) + cr({7})^ 7 ([w, x))j f'(x) dx. 



Hence v is absolutely continuous with density v' fulfilling (31) 



(32) 
□ 
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3.2. The reversed process. Given a PDMP on the real line and a fixed time T > 0, 
we define X* = Xi T _ t \ as before. As in the general case, under the Condition (|D]) this 
reversed process is a PDMP. Its deterministic path is decreasing with r*(x) = —r{x) and 
the active boundary is {w} if w > — oo. In contrast to the higher dimensional setting, in 
the present situation the integro-differential equation (31) for v enables us to express A* 
more explicitly. 

Remark 12. In practical applications one may use the following sufficient conditions to 
ensure that the conditions (|A^j)-(|D^]) hold. 

(1) A is continuous, bounded and bounded away from zero. This condition implies 
Qj), <@fej), Qj) and @. 

(2) For all x G IE*, n x (B) is absolutely continuous with density n' x {y), which is a 
continuous function of x. This implies ([A^]) and ([h^]). 

(3) there exists a stationary distribution v (which is necessarily absolutely continuous, 
see Proposition [3]) with density fulfilling v'{x) 7^ for x £ E°; then (|E|]) is obvious 
and since 

dK Q (z) = jig* fj,' x (z)X(x)i/(x)dx 

dv{z) v\z) ' { ' 

it follows that also dP%j ) is implied, too. 

(4) there is no active boundary or there exists e > such that fj, x (r(x) > e) = 1 for all 
x e T, implying ^ as well as (g^ (along with (1), see [22J (26.4), p. 60]). 

Condition ([E^j), local integrability of A*, has to be checked in each particular case. If for 
example \J X is bounded and l/v'{z) is locally integrable, then dD^j ) is fulfilled (see equation 
(33])). 

Theorem 5. If [J> x is absolutely continuous for all x G E with density \J X and r is absolutely 
continuous then so is u' (with derivative v" ) and if v'{x) 7^ 0, then 

\*(x) = \{x)+r'{x)+r{x) U ^ X l, x G E*, (34) 

u'(x) 

/4'(y) = I^^W, *GE, yGE*, (35) 
X*{x)v'{x) J 



^({7» = / », xGE*. (36) 

A*(x)i/(x) 



Proof. From Theorem [4] it follows that 1/ is absolutely continuous and by (25) and (15) we 
have: 



v' (u) (A*(u) — X{u)) = J X(x)^' x (u)u'(x) dx + j ij! x (u)o~(dx) — X(u)v' (u). (37) 
Hence from (|31l) it follows that 



f'(it) (A*(u) — A(u)) = / X(x)/i x (u)v' (x) dx — X(u)u' (u)fi u ([u, 7)) 



X(x)fi' x (u)u'(x) dx - X(u)u' '(u)fj, u ((— 00, u)) + cj({7})//! y ('u) 

(— oo,u) 



(r(u)v'(u))' 
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which proves ( 34 ) . The relation ( 35 ) follows from Proposition [5] since 



The proof of (36) is similar. □ 



Remark 13. It follows from ( |34[ ) that 

\*(x) — X(x) = r(x)[log(r(x)u'(x))) 

Suppose that we observe the stationary process in state x. If (log(r(x)i/(x)))' is positive 
(negative) then it is more likely (less likely) to find a jump in the near past than to find a 
jump in the near future. 

Let assume that the processes Xt,Wk,Qk have been continued to the left. This can 
easily be achieved by setting Xt equal to Y* t for t < 0, where Y* is the time reversal of 
an independent version (Yt)t>o of the PDMP. Then Q-i denotes the state of Xt just after 
the last jump before time 0. 

Corollary 1. If [i x is absolutely continuous for all x S E, then 

r( y y(y)P y (Wi>x) = r(xy(x)P x (Q-i<y), y<x£E. (38) 



Proof. Dividing (34) by v'(u) and integrating yields 

x X*(u) - X(u) ^ _ r x (r(u)u'(u))' _ ,r(x)v'(x) 
r(u) J y r(u)v'(u) r(y)i/(y) 

Using r*(x) = —r(x), we obtain: 

_ \(u) , ry x*(u) , 

r{y)v'{y)e J y r ^ = r(x)u'(x)e~ j * ^W) du . 
By Q this is equivalent to 

r{y)u'{y)e- ^ XMy ' s)) ds = r(x)i/(x)e" -C*^ x *^ x ^ ds , 
which is equivalent to (|38|). □ 



We assume in the following examples that the conditions (|A^j)-([B^j) and Condition (Jd]) 
are satisfied. See Remark 1121 for sufficient conditions. 



3.3. Renewal age process. 




Fig.: Forward recurrence time X t with F being a half-normal distribution with mean 1. 
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Consider the classic renewal process Nt with renewal times Ti,T2, If the distribution 

of T\ is absolutely continuous with distribution F{x) and density f(x) then the backward 
recurrence time Xt = t — T^ t is a PDMP with r(x) = 1 and A(x) being equal to the hazard 
rate — F(x)). The associated jump measure is, independently of x, concentrated 

in zero and the active boundary is empty (hence w 
that, provided that E{T\ 



and 7 = oo). It follows from (31) 
is finite, the density of the stationary distribution fulfills: 



v \x) 



[x,oo) 1 - F(z) 



' (z) dz. 



This leads to the well known fact that v is equal to the equilibrium or stationary excess 
distribution of F: 



v'{x) 



1 - F{x) 
E(Ti) 



The reversed process X* is the forward recurrence time process of the same renewal process. 
Applying Theorem [2] we see that X*(y) = for j/£E* and that 

f( X ) dx = M *(cfe)(T*({0}) 

from which, upon integration, c*({0}) = 1/E{T\) follows (the average number of visits to 
0) and hence ^{dx) = f{x) dx, which is not surprising: the upward jumps of the reversed 
process are just i.i.d. jumps with distribution F. Hence, for the trivial case of the renewal 
process our formulas yield the correct results. 



3.4. Generalized TCP window size process. 




10 15 

Fig.: Generalized TCP window size process with a = 1/2, /3 = 1, 7 = 1. 

In [ID] a generalized model for the TCP window size has been studied (see also [2J [M] 
[TBj |32l HI H2]). We assume that X t is a process with A(x) = \x@ , r(x) = rx a , j3 > a — 1 

and /x a ((0,y]) = (y/x) 7 , which means that Qk = U 1 ^ 1 ■ Wk, where the Uk are independent 
random variables with uniform distribution on (0, 1). In other words, at jump times the 

process is multiplied by the random number III . 

Using Theorem [4] it can be shown that under the condition f3 > a — 1 a unique stationary 
distribution v exists and 

A 



v [xj 



Cx^~ a exp ( 



-x 



r{P-a + \) 

(see (27) in [3D] for the normalizing constant C). Surprisingly, it follows from 

v"{x) 7 - a \xP- a 



u'{x) 
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that the jump intensity of the reversed process is of the same form as A: 

u"(x) 

X*(x) = X(x) + r'ix) + r(x)—j-^ = rjx" . 

v [x) 

As long as (3 > the reversed process X* cannot reach in finite time. If (3 < then 
the process could reach 0, but since a — 1 < j3 < —1, it follows that A* is not integrable 
on [0, e) for any e: the process will almost surely (and by construction even surely) jump 
before it reaches 0. 

The jump measure of the reversed process is of a different form than the one for the 
original process, namely 



_ X(y)^(xy(y) _ A „ , A 

^ x{V} ~ \*{x)v'{x) ~ r V eXp l r (/3-a + l) 

for y > x, so that we obtain a Weibull-type distribution 



a4(0&,v]) =exp( 



A 



r(0-a + l) 



(39) 



(40) 



If a = f3 then the upward jumps of X* follow an exponential distribution with mean r/A 
and the reversed process has additive jumps whereas the original process has multiplicative 
jumps (this has been observed in [55] ). 

3.5. Jumps independent of the current state. 

:c 
I 

6 

- 
2 
Z 




Fig.: r(x) = 1, X(x) = 1, H X (A) = t(A n [0, 10]), 7 = 10. 
Suppose that fJ, z (A) = fJ,(A) for all z € E and some absolutely continuous measure \x on 



[w,j). Then it follows from (31) that 

r{x)v'{x) = ( X(z)0(x, z)u'(z) dz + cr({ 7 })#(x, 7), xe(u>, 7 ), 

J w 

where 9(x,z) = (j,([w,x)) — l{ x > z }i implying that 

rx 

r{x)u'{x) = \\Z\\(i([w,x)) - / X{z)u'{z)dz, 

J w 

where ||f|| = QX{z)u'{z) dz + a{{^}). It follows that 

r(x)v"(x) + (r'(x) + X(x))v'(x) = ||f||//(x) (41) 
and hence, using v'(w) = 0, 

1 rX rx \( y ) 

Ax) = U\\-T\ / e~J^ dy d^(u). 

T\X) J w 
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Then it follows from (34) and (41) that 



*(«>-liei£H 



which is nothing else than (25) since ttq = \i here. Note that ||£|| can be found from the 



normalizing condition ^(E) = 1. 

3.6. Reflection. Suppose that Xt is a real valued PDMP with decreasing paths with the 
additional feature that once the process reaches the process stays in for an exponentially 
distributed time with mean 1 / A(0). We assume that r{x) < for all x > 0, so can actually 
be reached. Moreover the time to reach zero has finite mean. Technically this process is 
not a PDMP on the real line. Instead the process can be modelled as a PDMP with two 
outer states. We let EJ = (0, <r] with active boundary T\ = {0} and introduce a second 
component E^ which includes the point {0}. Also let r{x) = for all x G E^. Then the 
state space of X t is {(x, i)\x G E°, i G 1, 2}. Once X t hits (0, 1) it jumps to (0, 2) and stays 
there until it jumps back to E^. However, we avoid this cumbersome notation and just 
write E = [0, q\ and T = {0} and thereby allow E D T ^ 0. Note that the reversed process 
X*, after jumping to 0, stays there for an exponentially distributed sojourn time until it 
starts decreasing again. 

Theorem 6. The stationary distribution v is absolutely continuous on the interval (0,w). 
The density v 1 of v fulfills the integro- differential equation: 



r{x)v'(x)= \{z)6(x,z)v'{z)dz + A(O)i/({O})0(x, 0), ie(0,f), (42) 
Jo 

where 6(x, z) = l{ x < z }Hz([0, x)) - l{ x>z }^ z ([x, ?)) = ^([0, a;)) - l{ x>z y. 
Proof. As in the proof of Theorem El let / G jtf(L By Fubini's theorem 



Qf(z) = r(f(y)-f(z)) f i z (dy)=rf y f(x)dx^ z (dy) 

JO Jo Jz 

l{ z < x <y}t*z(dy)f'(x)dx- / / l {y<x<z} fj, z (dy)f'(x)dx 



J0 JO JO 







{l{x>z}Liz([x, <?)) - l{ x < z }Vz{[0, x)))f'(x) dx. 
It follows from M and Qf{i) = that 



r{x)f{x)v{dx) = - / \{z)Qf{z)v{dz) 



(0,?) Wo 



\(z)6(x, z)v{dz) + \(0)6(x, 0)z^({0})) f'(x) dx, 



so v is absolutely continuous and (42) holds. □ 



The parameters of the reversed process are given in Theorem [5] applied for —Xt and 
7 = 0, w = — <;. 
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Fig. : Risk process 

The workload (also virtual waiting time) process of a Markovian single server queue is 
denned as the amount of work left at the server at time t. This is a special case of the 
reflected process with <j = oo, where r(x) = —1, X(x) = A is constant and /i z ((x,oo]) = 
1 — F{x — z) for z < x, where F is a probability distribution on (0, oo). We assume that 
g = A — F(u)) du < 1, so that it can be shown that unique stationary distribution v 



exists. It then follows from (|42|) that 
v\x) 



X (1-F(x- z))u'(z) dz + Ai/({0})(1 
Jo 

Integrating yields 1 — z/({0}) = g(l — v{{0})) + u({0})g with g- 
which ^({0}) = 1 — q follows. 



-F(x)). 
A//o°°(l- 



(43) 

F(u)) du, from 



The renewal type equation (43) can be solved at least for numerical purposes in form 



of an infinite series of convolutions (the Pollaczek-Khintchine formula in the queueing 
context). Alternatively one can take Laplace transforms and find an equivalent relation 
for the transform. 

Provided that F is absolutely continuous with density function /, Theorem [5] implies: 



A*(x) 

(v) 



A + 



v"(x) 



/4({o}) 



u'{x) 

My) 

X*(x)v'(x 
A(l - q) 



x > 0, 



-f(x -y), x>0,y<x, 



fix) 



x > 0. 



\*{x)v'(xy 

Remark 14. It is interesting to look for conditions to obtain a constant jump rate for the 
reversed process. We have A* = A + C for some constant C, iff v"{x)/v'{x) = C, that is, 
if v'(x) = De is an exponential density with additional mass at zero. Then 

Az/(y) , A 



f(y 



,C(y-x) 



\v'{x) + v"{x 
depends only on {y — x). If we interpret g{y) 



f(y 



A 

(A+C) 



x + c 

e y f(y) as the density of the workload 



of an M/G/l queue, then it follows from the fact that v is a mixture of an exponential 
distribution with a mass at zero (see e.g. [3], Theorem 9.1) that g{x) is also exponential 
with mean 1/(3 and /3 = X* — C = X. 



Remark 15. Specializing Remark 13 if we ask ourself whether it is more probable, if we 
observe Xt in steady state, to have a claim in the near future than to have a claim in the 



near past, (44) shows that X*(x) > A if logz/ is increasing at x and X*(x) < A if logz/ is 
decreasing at x (no matter which claim size distribution is present). 
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